Image-Based Lifelogging: User Emotion Perspective

Lifelog is a digital record of an individual’s daily life. It collects, records, and archives a large amount of unstructured data; therefore, techniques are required to organize and summarize those data for easy retrieval. Lifelogging has been utilized for diverse applications including healthcare, self-tracking, and entertainment, among others. With regard to the image-based lifelogging, even though most users prefer to present photos with facial expressions that allow us to infer their emotions, there have been few studies on lifelogging techniques that focus upon users’ emotions. In this paper, we develop a system that extracts users’ own photos from their smartphones and configures their lifelogs with a focus on their emotions. We design an emotion classifier based on convolutional neural networks (CNN) to predict the users’ emotions. To train the model, we create a new dataset by collecting facial images from the CelebFaces Attributes (CelebA) dataset and labeling their facial emotion expressions, and by integrating parts of the Radboud Faces Database (RaFD). Our dataset consists of 4,715 high-resolution images. We propose Representative Emotional Data Extraction Scheme (REDES) to select representative photos based on inferring users’ emotions from their facial expressions. In addition, we develop a system that allows users to easily configure diaries for a special day and summaize their lifelogs. Our experimental results show that our method is able to effectively incorporate emotions into lifelog, allowing an enriched experience.     

An AW-HARIS Based Automated Segmentation of Human Liver Using CT Images

In the digestion of amino acids, carbohydrates, and lipids, as well as protein synthesis from the consumed food, the liver has many diverse responsibilities and functions that are to be performed. Liver disease may impact the hormonal and nutritional balance in the human body. The earlier diagnosis of such critical conditions may help to treat the patient effectively. A computationally efficient AW-HARIS algorithm is used in this paper to perform automated segmentation of CT scan images to identify abnormalities in the human liver. The proposed approach can recognize the abnormalities with better accuracy without training, unlike in supervisory procedures requiring considerable computational efforts for training. In the earlier stages, the CT images are pre-processed through an Adaptive Multiscale Data Condensation Kernel to normalize the underlying noise and enhance the image’s contrast for better segmentation. Then, the preliminary phase’s outcome is being fed as the input for the Anisotropic Weighted–-Heuristic Algorithm for Real-time Image Segmentation algorithm that uses texture-related information, which has resulted in precise outcome with acceptable computational latency when compared to that of its counterparts. It is observed that the proposed approach has outperformed in the majority of the cases with an accuracy of 78%. The smart diagnosis approach would help the medical staff accurately predict the abnormality and disease progression in earlier ailment stages.     

Prediction of rockhead using a hybrid N-XGBoost machine learning framework

The spatial information of rockhead is crucial for the design and construction of tunneling or underground excavation. Although the conventional site investigation methods (i.e. borehole drilling) could provide local engineering geological information, the accurate prediction of the rockhead position with limited borehole data is still challenging due to its spatial variation and great uncertainties involved. With the development of computer science, machine learning (ML) has been proved to be a promising way to avoid subjective judgments by human beings and to establish complex relationships with mega data automatically. However, few studies have been reported on the adoption of ML models for the prediction of the rockhead position. In this paper, we proposed a robust probabilistic ML model for predicting the rockhead distribution using the spatial geographic information. The framework of the natural gradient boosting (NGBoost) algorithm combined with the extreme gradient boosting (XGBoost) is used as the basic learner. The XGBoost model was also compared with some other ML models such as the gradient boosting regression tree (GBRT), the light gradient boosting machine (LightGBM), the multivariate linear regression (MLR), the artificial neural network (ANN), and the support vector machine (SVM). The results demonstrate that the XGBoost algorithm, the core algorithm of the probabilistic N-XGBoost model, outperformed the other conventional ML models with a coefficient of determination (R²) of 0.89 and a root mean squared error (RMSE) of 5.8 m for the prediction of rockhead position based on limited borehole data. The probabilistic N-XGBoost model not only achieved a higher prediction accuracy, but also provided a predictive estimation of the uncertainty. Thus, the proposed N-XGBoost probabilistic model has the potential to be used as a reliable and effective ML algorithm for the prediction of rockhead position in rock and geotechnical engineering.     

Actuator fault estimation based on generalized learning observer for quasi-linear parameter varying systems

This article presents a generalized learning observer (GLO) design for the simultaneous estimation of states and actuator faults for polytopic quasi-linear parameter varying systems. The proposed approach is based on the use of a GLO, which generalized the existing results on the proportional-integral observers. Conditions of existence and stability of the observer are given through the stability analysis in the sense of Lyapunov. Its design is obtained in terms of a set of linear matrix inequalities. The performance of the proposed method is evaluated by simulation in a one-link-flexible joint robot system.     

An unsupervised approach for fault diagnosis of power transformers

Electrical utilities apply condition monitoring on power transformers (PTs) to prevent unplanned outages and detect incipient faults. This monitoring is often done using dissolved gas analysis (DGA) coupled with engineering methods to interpret the data, however the obtained results lack accuracy and reproducibility. In order to improve accuracy, various advanced analytical methods have been proposed in the literature. Nonetheless, these methods are often hard to interpret by the decision-maker and require a substantial amount of failure records to be trained. In the context of the PTs, failure data quality is recurrently questionable, and failure records are scarce when compared to nonfailure records. This work tackles these challenges by proposing a novel unsupervised methodology for diagnosing PT condition. Differently from the supervised approaches in the literature, our method does not require the labeling of DGA records and incorporates a visual representation of the results in a 2D scatter plot to assist in interpretation. A modified clustering technique is used to classify the condition of different PTs using historical DGA data. Finally, well-known engineering methods are applied to interpret each of the obtained clusters. The approach was validated using data from two different real-world data sets provided by a generation company and a distribution system operator. The results highlight the advantages of the proposed approach and outperformed engineering methods (from IEC and IEEE standards) and companies legacy method. The approach was also validated on the public IEC TC10 database, showing the capability to achieve comparable accuracy with supervised learning methods from the literature. As a result of the methodology performance, both companies are currently using it in their daily DGA diagnosis.     

Predicting hydrogen adsorption and desorption rates in cylindrical metal hydride beds: Empirical correlations and machine learning

A major limitation in chemisorptive hydrogen storage in metal hydrides is the long time required for the adsorption reaction during charging. This study investigates how the shape and material of the reaction chamber influences the adsorption and desorption rates. Numerical simulations of hydrogen storage in a cylindrical reaction chamber filled with LaNi₅ hydride are conducted for a range of chamber thermal conductivities and aspect ratios. The results show that adsorption and desorption processes are limited by thermal diffusion in the hydride bed and storage chamber. A storage efficiency is proposed based on an ideal isothermal process and used to evaluate the impact of chamber thermal conductivity and aspect ratio on the adsorption and desorption rates. Empirical correlations are proposed for predicting the adsorption and desorption efficiency of cylindrical LaNi₅ hydride beds. Finally, a machine-learning based data model for predicting storage efficiency in metal hydride chambers is presented. Comparison against the empirical correlations highlights that the machine learning-based data model can predict the storage efficiency more accurately.     

Deep learning based pipeline with multichannel inputs for patent classification

This work introduces a deep learning pipeline for automatic patent classification with multichannel inputs based on LSTM and word vector embeddings. Sophisticated text mining methods are used to extract the most important segments from patent texts, and a domain-specific pre-trained word embeddings model for the patent domain is developed; it was trained on a very large dataset of more than five million patents. The deep learning pipeline is using multiple parallel LSTM networks that read the source patent document using different input dimensions namely embeddings of different segments of patent texts, and sparse linear input of different metadata. Classifying patents into corresponding technical fields is selected as a use case. In this use case, a series of patent classification experiments are conducted on different patent datasets, and the experimental results indicate that using the segments of patent texts as well as the metadata as multichannel inputs for a deep neural network model, achieves better performance than one input channel.     

The impact of hydrogen refueling station subsidy strategy on China's hydrogen fuel cell vehicle market diffusion

Lack of hydrogen refueling stations (HRSs) has hindered the diffusion of hydrogen fuel cell vehicles (HFCVs) in the Chinese transport market. By combining the agent-based model (ABM) and the experience weighted attraction (EWA) learning algorithm, this paper explores the impact of government subsidy strategy for HRSs on the market diffusion of HFCVs. The actions of the parties (government, HRS planning department and consumers) and their interactions are taken into account. The new model suggests dynamic subsidy mode based on EWA algorithm yields better results than static subsidy mode: HFCV purchases, HRS construction effort, total number of HRSs and expected HRS planning department profits all outperform static data by around 27%. In addition, choosing an appropriate initial subsidy strategy can increase the sales of HFCVs by nearly 40%. Early investment from government to establish initial HRSs can also increase market diffusion efficiency by more than 76.7%.     

Efficient fault diagnosis method of PEMFC thermal management system for various current densities

The temperature of a fuel cell has a considerable impact on the saturation of a membrane, electrochemical reaction speed, and durability. So thermal management is considered one of the critical issues in polymer electrolyte membrane fuel cells. Therefore, the reliability of the thermal management system is also crucial for the performance and durability of a fuel cell system. In this work, a methodology for component-level fault diagnosis of polymer electrolyte membrane fuel cell thermal management system for various current densities is proposed. Specifically, this study suggests fault diagnosis using limited data, based on an experimental approach. Normal and five component-level fault states are diagnosed with a support vector machine model using temperature, pressure, and fan control signal data. The effects of training data at different operating current densities on fault diagnosis are analyzed. The effects of data preprocessing method are investigated, and the cause of misdiagnosis is analyzed. On this basis, diagnosis results show that the proposed methodology can realize efficient component-level fault diagnosis using limited data. The diagnosis accuracy is over 92% when the residual basis scaling method is used, and data at the highest operating current density is used to train the support vector machine.